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ADAPTIVE CONTROL FOR UNCERTAIN 
NONLINEAR MULTI-INPUT MULTI-OUTPUT 
SYSTEMS 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

This application claims the benefit of U.S. Provisional 
Patent Application No. 61/303,182, filed Feb. 10, 2010, and 
entitled “Adaptive Control For Uncertain Nonlinear Multi- 
Input/Multi -Output Systems,” which is hereby incorporated 
by reference. 

STATEMENT CONCERNING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

This invention was made with government support under 
NNX08ABA65A awarded by NASA. The government has 
certain rights in the invention. 

BACKGROUND OF THE INVENTION 

The present invention relates generally to adaptive con- 
trols, and more particularly to adaptive controls for uncertain 
nonlinear multi-input multi -output systems. 

Aircraft autopilots have slow adaptive capabilities. To 
function in quickly changing environments, they resort to 
gain-scheduling of the controller parameters. A gain-sched- 
uled autopilot is obtained by designing a set of controllers at 
different operating points and then linearly interpolating con- 
troller values between them. Extensive gain-scheduling may 
be a very expensive and time-consuming procedure. Tradi- 
tional gain-scheduled autopilots react slowly to changes in 
conditions and can’t compensate for significant changes in 
aircraft dynamics like sudden, unexpected, severe control 
surface failures or serious vehicle damage (e.g., having a 
wing sheared off). 

The history of adaptive control is rich with methods for 
controlling systems in the presence of uncertainties. The 
development of these methods followed from the certainty 
equivalence principle. Assuming that the ideal parameters are 
known, conventional model reference adaptive control 
(MRAC) uses the nominal controller, parameterized in ideal 
parameters, to define the desired reference system based on 
perfect cancellation of uncertainties. Since the parameters are 
unknown, the adaptive controller is defined using the estima- 
tion of the unknown parameters from a gradient minimization 
scheme. Thus, one needs the estimation to be fast for better 
convergence, while on the other hand, increasing the speed of 
adaptation renders the adaptive controller high-gain and 
reduces the robustness of the closed-loop system to unmod- 
eled dynamics, time-delays, etc. A common sense was that 
adaptive control is limited to slowly varying uncertainties, but 
the trade-off between the rate of variation of uncertainties and 
the performance was not quantified. Despite the stability 
guarantees, the practical implementation of adaptive control- 
lers remained to be a challenge due to the lack of understand- 
ing how to tradeoff between adaptation, performance, and 
robustness. Because of these limitations, all successful imple- 
mentations of adaptive controllers in use today are gain- 
scheduled, thus defeating the main point of adaptation. 

Compared to the previous systems and methods of adaptive 
control, what is needed is an adaptive control that includes 
assured robustness in the presence of fast adaptation, thereby 
eliminating the need for gain-scheduling of the adaptive con- 
troller. 
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SUMMARY OF THE INVENTION 

The present invention overcomes the aforementioned 
drawbacks by providing systems and methods that yield an 
5 improved X , adaptive control architecture that allows for fast 
adaptive control and assured performance under quickly 
changing conditions, thereby eliminating the need for gain- 
scheduling of the adaptive controller. The need for gain- 
scheduling can be eliminated through the use of bandwidth- 
to limited (low-pass) filtering in the control channel, which 
appropriately attenuates the high frequencies typically 
appearing in fast adaptation situations. 

Mathematical equations and modeling show that the X x 
adaptive control architecture can be applied to general non- 
15 linear multi-input multi-output (MIMO) systems with signifi- 
cant unmatched uncertainties. The control system can be 
quickly and easily transferable to new systems, e.g., aircraft, 
regardless of differences in body structure or maximum abil- 
ity, which provides for a significantly decreased design and 
20 creation phases for new systems. Additional applications for 
the novel X j adaptive control architecture include, but are not 
limited to, ascent and attitude control for launch vehicles, 
satellite guidance and attitude control, flight control systems 
for both manned and unmanned aircraft, missile guidance 
25 systems, pressure control system for oil drilling, control of 
nuclear plants, automatic control of advanced medical 
devices, control of hysteresis in smart materials, control of 
power grids, and control of solution propagation along optical 
fibers. 

30 In accordance with one aspect of the invention, a method of 
adaptive control for an uncertain nonlinear multi-input multi- 
output system is provided. The method comprises providing 
a processor operable to execute a control law residing in a 
memory. The control law includes a bandwidth-limited filter 
35 configuration, and is configured to generate a control signal u c 
as an output of the bandwidth-limited filter configuration. The 
method further includes measuring a system state signal x, 
generating a prediction of the system state x, subtracting the 
prediction of the system state x from the measured system 
40 state signal x, and producing an error signal x; Estimates of 
uncertainties in the multi-input multi-output system are gen- 
erated, and the control signal u c is generated as an output of 
the bandwidth-limited filter configuration based on the gen- 
erated estimates of uncertainties and the measured system 
45 state x. 

In another aspect of the invention, an adaptive control 
system for controlling a nonlinear multi-input multi-output 
system with uncertainties is provided. The adaptive control 
system comprises a fast estimation scheme, with the fast 
50 estimation scheme including a state predictor and an adaptive 
law. The fast estimation scheme is configured to generate 
estimates of the uncertainties in the multi-input multi-output 
system. A control law i s included with the control law includ- 
ing a bandwidth-limited filter configuration. The control law 
55 is configured to generate a control signal u c as an output of the 
bandwidth-limited filter configuration. 

In yet another aspect of the invention, an adaptive control 
system is provided that comprises a processor operable to 
execute a control law residing in a memory, the control law 
60 including a bandwidth-limited filter configuration, the con- 
trol law configured to generate a control signal u c as an output 
of the bandwidth-limited filter configuration. A state predic- 
tor is configured to generate a prediction of a nonlinear multi - 
input multi -output system state x, such that when the system 
65 state x is subtracted from an actual system state x, an error 
signal is produced that, together with the actual system state 
x and the control signal u c , drives an adaptation process. 
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To the accomplishment of the foregoing and related ends, 
the invention, then, comprises the features hereinafter hilly 
described. The following description and the annexed draw- 
ings set forth in detail certain illustrative aspects of the inven- 
tion. However, these aspects are indicative of but a few of the 
various ways in which the principles of the invention can be 
employed. Other aspects, advantages and novel features of 
the invention will become apparent from the following 
detailed description of the invention when considered in con- 
junction with the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. 1 and 2 illustrate examples of an adaptive controller 
according to embodiments of the invention; 

FIG. 3 illustrates an exemplary configuration of the adap- 
tive controller shown in FIG. 1 in a standalone mode; 

FIG. 4 illustrates an exemplary configuration of the adap- 
tive controller shown in FIG. 2 in an augmentation mode; 

FIGS. 5A, 5B, and 5C show internal structure of the adap- 
tive controller shown in FIG. 1 when used in a standalone 
mode and with a fast estimation scheme based on piecewise 
constant adaptive laws; 

FIGS. 6A, 6B, and 6C show internal structure of the adap- 
tive controller shown in FIG. 1 when used in a standalone 
mode and with a fast estimation scheme based projection- 
based adaptive laws; 

FIGS. 7A, 7B, and 7C show internal structure of the adap- 
tive controller shown in FIG. 2 when used in an augmentation 
mode and with a fast estimation scheme based on piecewise 
constant adaptive laws; and 

FIGS. 8 A, 8B, and 8C show internal structure of the adap- 
tive controller shown in FIG. 2 when used in an augmentation 
mode and with a fast estimation scheme based projection- 
based adaptive laws. 

DETAILED DESCRIPTION 

Referring now to the drawings wherein like reference num- 
bers correspond to similar components throughout the several 
views, embodiments of the invention shall be described in the 
context of a multi-input multi-output state- feedback robust 
X j adaptive controller that automatically adjusts certain 
parameters and/or signals in the control loops to achieve 
desired performance specifications, both in transient and 
steady-state, in the presence of admissible model uncertain- 
ties, disturbances, and noises. In particular, the X t adaptive 
controller estimates part of these uncertainties and compen- 
sates for their undesirable effects at the output of the plant, 
while (similar to conventional Robust Control) the X , adap- 
tive controller is able to assure stability and a desired level of 
performance for the uncertainties that adaptation is not able to 
capture and adapt to. 

FIG. 1 shows an embodiment of the X , adaptive controller 
20 in a standalone mode, and FIG. 2 shows an embodiment of 
the X , adaptive controller 20 in an augmentation mode. 
Since analysis and synthesis of these feedback systems make 
explicit use of X , induced-norms of different signal map- 
pings, the adaptive architectures described herein will be 
referred to as X , adaptive controllers. 

Benefits of the X , adaptive controller 20 include its fast 
and robust adaptation which, unlike conventional adaptive 
control such as MRAC and Self-Tuning Regulators (STR), 
does not interact with the trade-off between performance and 
robustness. The separation (decoupling) of fast adaptation 
from robustness is achieved by appropriately inserting into 
the control structure a bandwidth-limited filter 30, which 
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ensures that the control signal stays in the desired frequency 
range and within the bandwidth of the control channel. 

The insertion of this bandwidth-limited filter configuration 
30 enables the use of estimation schemes with arbitrarily high 
5 adaptation rates, which are only subject to hardware limita- 
tions, without resulting in high-gain feedback control. In this 
context, high adaptation rates generally mean rates that lead 
to a time scale of the adaptation process that is substantially 
faster than the time scales associated with plant variations and 
to underlying closed-loop dynamics. In this sense, high adapta- 
tion rates allow for compensation of the undesirable effects of 
rapidly varying uncertainties and significant changes in sys- 
tem dynamics. High adaptation rates are also important to 
achieve assured transient performance for a system’s input 
15 and output signals, without resorting to gain-scheduling of 
the control parameters, persistency of excitation, or control 
reconfiguration. Moreover, the bandwidth-limited filter keeps 
the robustness margins, for example, the time-delay margin, 
bounded away from zero in the presence of these arbitrarily 
20 fast estimation schemes. To this extent, the bandwidth and 
structure of the bandwidth-limited filter configuration 30 
defines the trade-off between performance and robustness. 

The X j adaptive controller 20 described herein has the 
ability to compensate for the effect of general unmatched 
25 uncertainties that cannot be addressed by recursive design 
methods developed for strict-feedback systems, semi-strict- 
feedback systems, pure-feedback systems, and block-strict- 
feedback systems. Tins implies that, to some extent, in the 
design of the controller, the desired dynamics can be selected 
30 without enforcing matching conditions. 

The next sections present a detailed description of different 
elements that integrate the X 1 adaptive control architecture, 
and explain how these elements can be designed and com- 
bined to achieve stability, robustness, and improved perfor- 
35 mance. In particular, a desired position in the control structure 
will be described where the bandwidth-limited filter may be 
inserted in order to benefit from the properties mentioned 
above. 

Control Architecture 

40 Embodiments of the X j adaptive controller 20 systems 
and methods include a fast estimation scheme (FES) 50 and a 
control law (CL) 60. The FES 50 includes a state-predictor 52 
and appropriately designed adaptive laws 54, and is used to 
generate estimates of the uncertainties present in the plant 70 
45 (see FIGS. 3 and 4) based on the measured state signal x and 
the control signal u c . The state-predictor 52, which is 
designed to mimic the actual plant structure and to specify the 
desired behavior of the closed-loop system, generates a pre- 
diction of the system state x. This prediction, when subtracted 
50 from the actual system state x, yields an error signal x that, 
together with the measured state signal x and the control 
signal u c , drives the adaptation process. The adaptive laws 54 
update the estimates of the uncertainties present in the plant 
62 at a high adaptation rate. The FES 50 may also include one 
55 or more optional elements to introduce damping in the adap- 
tation loop. Then, based on the estimates of the uncertainties 
and also the measured state signal x, the CL 60 generates the 
control signal u c as the output of the bandwidth-limited filter 
configuration 30. As described earlier, this filtering process 
60 ensures that the control signal u c has limited frequency con- 
tent within the bandwidth of the control channel and leads to 
separation between adaptation and robustness. 

The internal structure of both the FES 50 and the CL 60 
may depend on whether the X ! adaptive controller is used in 
65 standalone mode or as an augmentation of a baseline tracking 
controller. The architecture structure of the X 1 adaptive con- 
troller in one embodiment of a standalone mode is shown in 
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FIG. 1, while an embodiment of an implementation as an 
augmentation control system is illustrated in FIG. 2. FIG. 3 
shows an overall control structure with the X , adaptive con- 
troller in a standalone mode. As can be seen, the control 
structure includes the plant 62 and the stability (de)augmen- 5 
tation and allocation function 64. FIG. 4 shows an overall 
control structure with the X , adaptive controller in an aug- 
mentation mode. Similarly, the control structure includes the 
plant 62 and the stability (de)augmentation and allocation 
function 64, and also includes the baseline tracking controller to 
66 . 

Moreover, to illustrate that the choice of the FES 50 is not 
unique, equations are provided for both standalone and aug- 
mentation modes of two different FES, one based on piece- 
wise constant adaptive laws, and another one using projec- 15 
tion-based adaptive laws. 

To streamline the subsequent description, definitions are 
introduced. In what follows, control architectures are consid- 
ered with n system states available for feedback, m(<n) sys- 
tem outputs subject to performance specifications, and m 20 
control signals. The following notations will also be used: 

A m : (eR "*") known Hurwitz matrix defining the desired 
dynamics for the closed-loop system. 

B m : (eR "*'") known control matrix (obtained, for example, 
from linearization about a given operation condition). 25 
C: (eR'"*") known output matrix. 

x(t): (eR ") system state (measured). It consists of plant 
states, x (t), and/or baseline controller states, x„(t). 
y(t): (eR '") system output (measured). Linear combination of 
the states of the system subject to performance specifica- 30 
tions, y(t)=Cx(t). 
r(t): (eR m ) bounded setpoint. 
u c (t): (eR m ) adaptive control signal. 
x(t): (eR ") state-predictor state. 

x(t): (eR ”) error signal between system state and state-pre- 35 
dictor state, x(t)=x(t)-x(t). 

B„ m : (eR constant matrix such that B m r B„„=0 and 

also rank ([B„,B„J)=n. 

B: (eR "*”) constant matrix defined as B=[B m B„ m ]. 

H m (s): (e322T Jmxm matched transfer matrix, H m (s)=C(s 40 
11 „-A m ) _1 B m . It is assumed that the transmission zeros 
of H m (s) lie in the open left -half plane. 

H„ m (s): (tJM-C Jmx(n-m) unmatched transfer matrix H um 
(s)=C(sl„-AJ- 1 B„ m . 

A. Standalone “All-Adaptive” Mode 45 

1) Piecewise Constant Adaptive Laws (X jSl). 

Referring to FIGS. 5A, 5B, and 5C, an embodiment of an 
X 1 adaptive control architecture is presented in standalone 
mode with a FES based on piecewise constant adaptive laws. 

Referring to FIG. 5A, the following state-predictor 72 is 50 
considered: 

where L e R "*" is such that A^— A m +L is a Hurwitz matrix; 
x 0 is the best guess of the initial system state; ri^tjeR m and 55 
r| 2 (t)e R ”~ m are the adaptive estimates; while u(t) is the output 
of the following nonlinear “actuator” dynamics: 

xW=X6cW^(r),r.«ir),«ir-T)),x(0)=Xo 

60 

In the above equations, x(t)eR 7 is the “actuator” state, x is 
a time delay design parameter, and f H (*) and h I( (*) are nonlin- 
ear (in some embodiments possibly piecewise-defined) func- 
tions. These nonlinear actuator dynamics can be used to 65 
incorporate into the design nominal actuator models, 
dynamic saturation models, known input time delays, etc., as 
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non-limiting examples. In particular, including saturation 
models is important to ensure stability of the closed-loop 
system when the actuators saturate. 

Referring to FIG. 5B, the adaptive laws 74 for r| x (t) and 
r| 2 (t) are defined as: 


'hW 
fh (0 


\K 0 

0 u $(T s )i(/T s ),re[/T s ,(/ + l)r s ). 


for i=0, 1 , 2 ,..., where T,>0 is the adaptation sampling time, 
which can be associated with the sampling rate of the avail- 
able CPU, and 


<t>( T s )=-B-'(A,r , (e 4 ’ T ’- 1 „r M,2i . 

Referring to FIG. 5C, the control signal of the control law 
70 is generated as follows: 

u c (s)=K g (s)i\s)-C,(s)r\ l (s)-C 2 (s)H m -\s)H um (s)r\ 2 (s) 

where C^s) 76 and C 2 (s) 78 are mxm strictly -proper and 
stable bandwidth-limited filters, and K s (s) is an mxm proper 
and stable prefilter that can be designed to achieve desired 
decoupling properties. The transfer matrix C 2 (s) must be 
designed so that C 2 (s)H„T 1 (s)H„„,( s ) is a proper transfer 
matrix. 

2) Projection-Based Adaptive Laws (X jS2). 

Referring to FIGS. 6A, 6B, and 6C, an embodiment of an 
X j adaptive control architecture is presented in standalone 
mode with a FES using projection-based adaptive laws. 

Referring to FIG. 6A, the following state-predictor 82 is 
considered: 

x(O=/t^e(r)5„(ft)(r)«(f)+0i(f)PiWO))+^™(e 2 (r)P2WO))+ 

Lx(t)$( 0)=x o 

where LeR ”*" is such that A 5 = A m +L is a Hurwitz matrix; x 0 
is the best guess ofthe initial system state; co(t)eR mxm , 0 2 (t)e 
R mxp ', and0 2 (t)eR ( "”'" ) * P2 are the adaptive estimates; pjWe 
R'f’ 1 and P 2 ( , )€R- P2 are the matched and unmatched regres- 
sors; while u(t) is the output of the following nonlinear 
“actuator” dynamics: 


In the above equations, x(t) 6 ® 7 is the “actuator” state, x is 
a time delay design parameter, and f M (*) and h„(*) are nonlin- 
ear (possibly piecewise-defined) functions. 

Referring to FIG. 6B, the adaptive laws 84 for w(t), 0 L (t), 
and 0 2 (t) are defined as: 

m(t)=r?roi(m(t)-(x T (t)PBJ T u T (t)MO)=a>o> 


e,(r)=rProj (0 1 (f),-(* r (f)i«„) r p 1 r Wf)),e 1 (O)-e lo , 


0 2 W = rProj(0 2 (r)-(* r (d^®„ m ) r p 2 r wo),e 2 (o)=0 2o , 

where Te R + is the adaptation gain; P=P r >0 is the solution to 
the algebraic Lyapunov equation A i . r P+PA v =-Q, Q=Q r >0; 
and Proj(*,*) denotes the projection operator. 

The projection operator can be defined as follows: 

Let 0 be an unknown parameter, and assume that it belongs 
to the convex compact set 0. Then, the projection operator 
Proj(v) is given by: 
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Proj(8, 


V/iV /T yh@) 
l|V/i|| 2 


if h(8) < 0 

if h(0) > 0, VtTx < 0 
if h(0) > 0, V IT x > 0 


where h(0) = 



e 0 0 max 


5 
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with 0 max eR + being the norm bound imposed on 0, and e 6 e 
R + being the convergence tolerance of the bound. By appro- 
priately choosing Q max and e e the Proj operator ensures that 
0(t) 60 for all t>0. The following property of the projection 15 
operator is used in the corresponding Lyapunov analysis. 

Lemma: given x, 0eR ", we have: 


(0-0) r (Proj(0,*)-.x)£O, where 0 is the true value of 0. 

Referring to FIG. 6 C, the control signal of the control law 
80 is the output of the feedback structure and is generated as 
follows: 


"c(A)=-K(p 0 (s){As)+D 1 (syr\ 1 (s)+D 2 (s)H m '(s)H um ( s) 
ti 2 (s)-K g (s)r(s)) 

where KeR mxm is a matrix gain, p(s), tq^s), and r| 2 (s) are the 
Laplace transforms of the signals p(t)=co(t)u(t), r| t (t)=0 1 (t)(3 l 
(x(t)), and r| 2 (t)=e 2 (t)P 2 (x(t)), D 0 (s), Dj(s) and D,(s) are 
mxm proper transfer matrices, and K^(s) is an mxm proper 30 
prefilter that can be designed to achieve desired decoupling 
properties. The transfer matrix D 2 (s) must be designed so that 
D 2 (s)H m -1 (s)H Mm (s) is a proper transfer matrix. In embodi- 
ments of this architecture, the bandwidth-limited filter 86 
may be constructed using a feedback structure in the control 35 
law and is characterized by the matrix gain K and the transfer 
matrices D 0 (s), D^s) and D,(s) (see C. REMARKS). 

B. Augmentation Mode 

1) Piecewise Constant Adaptive Laws (X jAl). 40 

Referring to FIGS. 7A, 7B, and 7C, an embodiment of an 
X 1 adaptive architecture is presented in augmentation mode 
with a FES based on piecewise constant adaptive laws. 

Referring to FIG. 7A, the following state-predictor 92 is 
considered: 45 


x(0 = ^^(0+^(d+-S™("(d+Ui(d+A, m ‘n2(d+MhA0)^o. 

where B^eR”*"' is the command control matrix (obtained 
from closing the loop with the baseline tracking controller); 5Q 
r g (t) is the signal with Laplace transform r g (s)=K g (s)r(s), with 
K^(s) being an mxm proper and stable prefilter that can be 
designed to achieve desired decoupling properties; Le R " x " is 
such that A^- A m +L is a Flurwitz matrix; x 0 is the best guess 
of the initial system state; ri^tjeR and r| 2 (t)eR ”~ m are the .. 
adaptive estimates; while u(t) is again the output of the fol- 
lowing nonlinear “actuator” dynamics: 

XtfWMMt), f.«*M>«*0-x)),x(°) = Xo 

60 

T ))- 

In the above equations, x(t)eR ' is the “actuator” state, x is 
a time delay design parameter, and f„(*) and h„(*) are nonlin- 
ear (possibly piecewise-defined) functions. 65 

Referring to FIG. 7B, the adaptive laws 94 for ri^t) and 
r| 2 (t)) are defined as: 


ri7i(r)l l» m 0 1 

L)Ho l „|™ I E[,T s ,( i+ i ) r s ), 

for i=0, 1,2,..., where T s >0 is the adaptation sampling time, 
which can be associated with the sampling rate of the avail- 
able CPU, and 

Referring to FIG. 7C, the control signal of the control law 
90 is generated as follows: 

u c (s)=-C 1 (s)n 1 ^)-C 2 (sW,^\s)H um ^) U2(s) 

where C^s) 96 and C 2 (s) 98 are mxm strictly-proper and 
stable bandwidth-limited filters. The transfer matrix C,(s) 
must be designed so that C 2 (s)H„, _1 (s)H„ m (s) is a proper 
transfer matrix. 

2) Projection-Based Adaptive Laws (X X A2) 

Referring to FIGS. 8A, 8B, and 8C, an embodiment of an 
X , adaptive control architecture is presented in augmenta- 
tion mode with a FES using projection-based adaptive laws. 

Referring to FIG. 8A, the following state-predictor 102 is 
considered: 

X=^„r*(f)+^(f)+5„(O)(f)«(f)+0 1 (f)P 1 Wf))+S„„(e2(O)P2Wf)))+ 

Lx(t)^(0)=x o , 

where B,.€R is the command control matrix (obtained 
from closing the loop with the baseline tracking controller); 
r ? (t ) i s the signal with Laplace transform r g (s)=K g (s)r(s), with 
K s (s) being an mxm proper and stable prefilter that can be 
designed to achieve desired decoupling properties; LeR is 

such that A s - A„,+L is a Hurwitz matrix; x 0 is the best guess 
of the initial system state; u)(t)eM mxm , 0j6R mxp \ and 0 2 (t)e 
R are the adaptive estimates; p^'jeR^ 1 and p 2 (') 6 

R p - are matched and unmatched regressors; while u(t) is the 
output of the following nonlinear “actuator” dynamics: 

In the above equations, x(t) eR 1 is the “actuator” state, x is 
a time delay design parameter, and f„(*) and h„(*) are nonlin- 
ear (possibly piecewise-defined) fimctions. 

Referring to FIG. 8B, the adaptive laws 104 for w(t), 0 x (t), 
and 0 2 (t) are defined as: 

w=rProj(<i)(l),-(x T (r)Pfi m ) T u r (t))<i>(0)=<i> 0 , 

0 2 (O = rProj(0 2 (r),-(x r (r)/ , B„) r p 2 r (jrfO))0 2 (O)=02 o , 

where Te R + is the adaptation gain; P=P r >0 is the solution to 
the algebraic Lyapunov equation A s r P+PA i =-Q, Q=Q r >0; 
and Proj(*,*) denotes the projection operator. 

As previously described, the projection operator can be 
defined as follows: 

Let 0 be an unknown parameter, and assume that it belongs 
to the convex compact set 0. Then, the projection operator 
Proj(v) is given by: 


Proj[8 , xj 


x if h(6) < 0 

x if h (9) > 0, V h x < 0 

x : — 4- if h(d) > 0, V/i T * > 0 

IIV/jII 2 
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where h(6) = 



e 0 0 max 


with + being the nonn bound imposed on 0, and 6 0 6 

M + being the convergence tolerance of the bound. By appro- 
priately choosing Q max and e e the Proj operator ensures that 
0(t)e0 for all t>0. The following property of the projection 
operator is used in the corresponding Lyapunov analysis. to 

Lemma, given x, 06 M ", we have: 

(0-0) r (Proj(0,x)-*)£O, where 0 is the true value of 0. 

Referring to FIG. 8C, the control signal of the control law 
100 is the output of the feedback structure and is generated as 15 
follows: 

u c (s)=K(D 0 (s)[i(s)+D l (s)r\ l (s)+D 2 (s)H w - i (s)H t ,Js)r ]2 

«) 

whereKelK m>< '" is a matrix gain, p(s), r]^(s), andr| 2 (s)are the 20 
Laplace transforms of the signals p(t)=o>(t)u(t), r| , (t)=0 1 (t)(3 x 
(x)(t)), and f| 2 =02(t)P2(x)(t)), D 0 (s), d/(s), and D 2 (s) are 
mxm proper transfer matrices, and K (s) is an mxm proper 
prefilter that can be designed to achieve desired decoupling 
properties. The transfer matrix D 2 (s) must be designed so that 25 
D 2 (s)H m _1 (s)H„ m (s) is a proper transfer matrix. In embodi- 
ments of this architecture, the bandwidth-limited filter 106 
may be constructed using a feedback structure in the control 
law and is characterized by the matrix gain K and the transfer 
matrices D 0 (s), D^s) and D 2 (s) (see below). 30 

C. Remarks 

1) Construction of the bandwidth-limited filter 86, 106 in 
projection-based FES. 

When there is explicit adaptation on the input gain of the 
plant (see algorithms for IK jS2 and IK jA2 above), the band- 35 
width-limited filter is preferably constructed using a feedback 
structure in the control law. Next it is shown how this filtering 
process takes place in the algorithm IK t S2 for the case of a 
nominal linear actuator model. Similar manipulations lead to 
the same filter structure for the algorithm IK t A2. 40 

Let co 0 be the actual input gain of the system to be con- 
trolled. Then, we can define the signal r|(t) as: 

n(0=“o«(0+((i>(0-»o)«(h+ni(h+n2 ra (h-'i.(h. 

where r| 2m (t) is the signal with Laplace transform r| 2m (s)= 45 
H m _1 (s)H„ m (s) rj 2 (s). 

For the case of a linear actuator model W at ,,(s), we have that 
u(s)=W a£ , t (s) u c (s), and therefore: 


I X s ) = M oW„a(s)u c (s) + u^s) + f) i (s) + ri 2m (s) - r g (s) 

= -uoWac,(s)KD(s)r)(s) + u^fs) + i), (s) + - r g (s). 


50 


where we have taken D(s)=D 0 (s)=D 1 (s)=D 2 (s) and u 0) (s) is 
the Laplace transform of the signal u^(t)=(co(t)-co 0 )u(t). Iso- 
lating r|(s) in the above expression yields: 

U(-s)=[ 11 m +Uoii r act (s)KD(s)]-‘(u^(s)+r il (s)+r\ 2m (s)- rg 

(■*))> 60 

which implies that: 

uJs)=-KI)(s)\ D „,+0) : >fr, J , ,(.s)A7>(.S') | 1 /i.. ,(.s )+r[ , ' .s )+ 

na.W-'iC*))- 

This control signal u c (t) is sent to the plant 62, which has 65 
input gain to 0 and actuator W flcr (s), resulting in the effective 
control effort: 
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( 0 0 ff r aee (s)u e (s)=-< 0 0 W acr (s)KD(s) [ D m +<i> 0 W a Js)KD 
(■s)r 1 ("2 J (s)+Ui(-s)+U2„C- s )-''^)). 

The design elements K and D (s) in the control law of the 
X , adaptive control architecture can be chosen to assure that 
the filtering structure 


cw=%^wj)i 11 ,,+wo^Cswdmt 1 

is strictly proper and stable, and has a limited bandwidth, for 
all admissible plant input gains co 0 and admissible actuators 
W ac ,(s). 

2) Control Architecture Monitoring. 

The error signal x(t) can be used for monitoring and super- 
vision of the correct implementation of the X l adaptive con- 
troller. For proper operation, the amplitude of the components 
of this error signal is desirably several orders of magnitude 
smaller that the amplitude of the corresponding components 
of the actual system state. Moreover, the amplitude of this 
error signal should decrease as the adaptation rate of the FES 
increases. To be more precise, fulfillment of these require- 
ments would indicate proper design and implementation of 
the adaptive laws of the X x adaptive controller, and would 
restrict the search of possible implementation errors to the 
state-predictor and control law blocks. 

3) Adding Damping to Adaptation. 

The optional term Lx(t) in the state-predictor of the X l 
adaptive control architecture is meant to add damping to the 
adaptation process. This optional element, if properly 
designed, has the ability to damp down the high-frequency 
oscillations present in the signals of the adaptation loop, and 
might also increase the robustness margins of the closed-loop 
adaptive system. This additional damping, however, spoils 
the adaptation process, and thus leads to reduced perfor- 
mance. 

4) Unmatched Uncertainties. 

Embodiments of the X j adaptive control architectures pre- 
sented above include estimation and compensation for gen- 
eral unmatched uncertainties. If the plant to be controlled is 
free from this kind of uncertainties, or compensation for their 
undesirable effects is not required or needed, adaptation to the 
unmatched component of the uncertainties can be disabled in 
the control algorithm, both in the FES 50 and in the CL 60. 
Also, additional embodiments of the X 1 adaptive control 
architectures can be developed for uncertain plants that can be 
represented in strict-feedback form, semi-strict-feedback 
form, pure-feedback form, or block-strict-feedback form. 

5) Architecture Modifications. 

Embodiments of the X , adaptive control architectures pre- 
sented above admit several modifications and extensions. For 
example, a filtering unit can be added at the input of the 
controller for conditioning the feedback signals, or control 
allocation schemes can be implemented for distributing a 
desired total control effort among a redundant set of control 
effectors. Also, the matrices A m , B m , B„ m , and B r may be 
time-varying (gain-scheduled) to accommodate a priori 
knowledge of the plant dynamics or different performance 
specifications at different operating conditions. 

6) Combined Standalone-Augmentation Adaptive Archi- 
tecture. 

Embodiments of the X j adaptive control architectures pre- 
sented above are developed to be implemented either in stan- 
dalone mode or as an augmentation of a baseline tracking 
controller 66. It is possible, nevertheless, to combine both 
approaches and implement an X , adaptive controller aug- 
menting a baseline controller that provides tracking capabili- 
ties only for some of the channels. 
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7) Connection to MRAC Architectures. 

In the absence of adaptation on the system input gain and 
compensation for unmatched uncertainties, the X , adaptive 
control architecture may reduce to a conventional state-pre- 
dictor based adaptive scheme, which can be similar to a direct 5 
MRAC architecture, with an additional bandwidth-limited 
filter 30 inserted in the control path. The presence of this 
bandwidth-limited filter is important to develop adaptive con- 
trol schemes providing desired uniform transient perfor- 
mance with assured robustness margins. to 

In fact, in the absence of this filter (e.g., a pure MRAC 
architecture), adaptation interacts with performance and 
robustness, which implies that the standard, well-known 
trade-off between performance and robustness in control sys- 
tem design becomes a “three-party” trade-off between adap- 15 
tation, performance, and robustness. Increasing the speed of 
adaptation leads to loss of robustness, whereas slow adapta- 
tion leads to lack of transient characterization with respect to 
the change in reference inputs, initial conditions, uncertain- 
ties, etc. Due to this inherent limitation of conventional adap- 20 
five control architectures and despite the vast improvements 
in adaptive control design methods and adaptation laws 
observed during the years, adaptive control has largely 
remained as a tool for adapting only to slowly varying uncer- 
tainties. Moreover, the lack of guidelines to solve the trade- 25 
off between adaptation, performance, and robustness makes 
the design of conventional adaptive controllers an overly 
challenging problem. 

The insertion of the bandwidth-limited filter configuration 
30 overcomes these difficulties. As explained earlier, it leads 30 
to separation of adaptation from robustness, which enables 
the use of fast estimation schemes in adaptive control, and the 
application of systematic design procedures that significantly 
reduce the tuning effort required to achieve desired closed- 
loop performance, particularly while operating in the pres- 35 
ence of uncertainties and failures. 

The novel X 1 adaptive control systems and methods are 
quickly and easily transferable to new platforms, regardless 
of differences in body structure or maximum ability. The need 
for gain-scheduling is eliminated through the use of fast esti- 40 
mation schemes in combination with bandwidth-limited 
(low-pass) filtering in the control channel, which attenuates 
the high frequencies typically appearing due to fast adapta- 
tion. 

The novel X : adaptive control architecture described 45 
above provides assured performance and robustness in the 
presence of fast adaptation. Performance limitations are only 
limited by hardware limitations. This novel architecture 
extends the prior architecture of X 1 adaptive control theory to 
general nonlinear multi-input multi-output systems in the 50 
presence of significant unknown unmatched uncertainties. 
The architecture relies on separation of adaptation from 
robustness, which allows for increasing the rate of adaptation, 
subject only to CPU limitations, while in the meantime main- 
taining assured robustness margins. 55 

Prior architectures of adaptive control did not exhibit these 
features. Namely, the prior architectures tend to lose robust- 
ness in the presence of fast adaptation. Thus, they require 
more tuning and gain-scheduling, which defeats the point of 
adaptation. 60 

As compared to prior architectures, the novel X , adaptive 
control architecture can be applied to multi-input and multi- 
output nonlinear systems in the presence of unmatched uncer- 
tainties. These features of the X l adaptive control architec- 
ture have been demonstrated on a variety of flight models, and 65 
may be configured to control different flight models without 
redesign or retuning for various flight conditions and yields 


12 

uniform scaled response, dependent upon changes in initial 
conditions, system uncertainties, and various reference 
inputs. This particular feature can significantly reduce the 
control design costs for industry and simplify their verifica- 
tion and validation process. Prior architectures were not 
meant for controlling general multi-input multi-output sys- 
tems in the presence of unknown unmatched dynamics. From 
the application stand-point, this allows for extending the 
flight regimes up to high-angles of attack, including stall, 
without resorting to gain-scheduling and without the need of 
retuning. 

It is expressly contemplated that any of the processes or 
steps described herein may be combined, eliminated, or reor- 
dered. In other embodiments, instructions may reside in com- 
puter readable medium wherein those instructions are 
executed by a processor to perform one or more of processes 
or steps described herein. As such, it is expressly contem- 
plated that any of the processes or steps described herein can 
be implemented as hardware, software, including program 
instructions executing on a computer, or a combination of 
hardware and software. Accordingly, this description is 
meant to be taken only by way of example, and not to other- 
wise limit the scope of tills invention. 

Those skilled in the art will appreciate that the embodi- 
ments disclosed herein may be used in accordance with other 
estimation schemes. The present invention may be embodied 
in other specific forms without departing from its spirit or 
essential characteristics. The described embodiments are to 
be considered in all respects only as illustrative and not 
restrictive. The scope of the invention is, therefore, indicated 
by the appended claims rather than by the foregoing descrip- 
tion. All changes which come within the meaning and range 
of equivalency of the claims are to be embraced within their 
scope. 

We claim: 

1. A method of adaptive control for an uncertain nonlinear 
multi-input multi-output system, the method comprising: 

providing a processor operable to execute a control law 
residing in a memory, the control law including a band- 
width-limited filter configuration, the control law con- 
figured to generate a control signal u c as an output of the 
bandwidth-limited filter configuration; 

measuring a system state signal x; 

generating a prediction of the system state x; 

subtracting the prediction of the system state x from the 
measured system state signal x, and producing an error 
signal x; 

generating estimates of uncertainties in the multi-input 
multi-output system; and 

generating the control signal u c as an output of the band- 
width-limited filter configuration based on the generated 
estimates of uncertainties and the measured system state 
x. 

2 . The method according to claim 1 further including gen- 
erating the estimates of uncertainties based on the measured 
system state signal x and the control signal u c . 

3. The method according to claim 1 further including pro- 
viding a state-predictor configured for mimicking the multi- 
input multi-output system and for specifying desired system 
behavior. 

4 . The method according to claim 1 further including 
updating the estimates of the uncertainties at a high adapta- 
tion rate. 

5. The method according to claim 1 wherein the adaptive 
control system is a closed-loop system. 
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6. The method according to claim 1 wherein the multi- 
input multi-output system is in the presence of significant 
unmatched uncertainty. 

7. The method according to claim 1 wherein the band- 
width-limited filter configuration comprises mxm strictly- 
proper and stable bandwidth-limited filters, wherein m sys- 
tem outputs and m control signals are included in the mxm 
strictly -proper and stable bandwidth-limited filters. 

8. An adaptive control system for controlling a nonlinear 
multi-input multi -output system with uncertainties, the adap- 
tive control system comprising: 

a fast estimation scheme, the fast estimation scheme 
including a state predictor and an adaptive law, the fast 
estimation scheme configured to generate estimates of 
the uncertainties in the multi-input multi-output system; 
and 

a control law, the control law including a bandwidth-lim- 
ited filter configuration, the control law configured to 
generate a control signal u^ as an output of the band- 
width-limited filter configuration. 

9. The system according to claim 8 wherein the estimates of 
the uncertainties are generated based on a measured system 
state x and the control signal u c . 

10. The system according to claim 8 wherein the state- 
predictor is configured to mimic the multi-input multi-output 
system and to specify desired system behavior. 

11. The system according to claim 9 wherein the state- 
predictor is configured to generate a prediction of the system 
state x, the prediction of the system state x then being sub- 
tracted from the measured system state x, to produce an error 
signal x; and 

the error signal x together with the measured system state 
signal x and the control signal u c , drives the adaptive 
process. 

12. The system according to claim 9 wherein the control 
law generates the control signal u c based on the estimates of 
uncertainties and the measured system state x. 
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13. The system according to claim 8 wherein the adaptive 
law is configured to update the estimates of the uncertainties 
at a high adaptation rate. 

14. The system according to claim 8 wherein the adaptive 
5 control system is a closed-loop system. 

15. The system according to claim 8 wherein the multi- 
input multi-output system is in the presence of significant 
unmatched uncertainty. 

16. An adaptive control system comprising: 

10 a processor operable to execute a control law residing in a 
memory, the control law including a bandwidth-limited 
filter configuration, the control law configured to gener- 
ate a control signal u^. as an output of the bandwidth- 
15 limited filter configuration; and 

a state predictor configured to generate a prediction of a 
nonlinear multi -input multi-output system state x, such 
that when the system state x is subtracted from an actual 
system state x, an error signal is produced that, together 
20 with the actual system state x and the control signal u c , 
drives an adaptation process. 

17. The system according to claim 16 wherein the band- 
width-limited filter comprises a feedback structure in the 
control law. 

25 18. The system according to claim 16 wherein the control 

signal _ u, equals K g (s)r(s)-C 1 (s)r| 1 (s)-C 2 (s)H„ i ‘ 1 (s) 
wherein 
K g (s) is a prefilter, 
r(s) is a bounded setpoint, 

30 Cj (s) and C,(s) are bandwidth-limited filters, 
r|j(s) and r| 2 (s) are adaptive laws, 

I V 1 (s) is an inverse of a matched transfer matrix, and 
H Mm (s) is an unmatched transfer matrix. 

19. The system according to claim 18 wherein C^s) and 
35 C 2 (s) are stable bandwidth-limited filters. 





